---
title: What are Models?
sidebarTitle: Overview
description: Language Models are machine-learning programs that are trained to understand natural language and code.
---

When we discuss Models, we are normally referring to Large Language Models (LLMs).

These models act as the **brain** of your Agents - enabling them to reason, act, and respond to the user. The better the model, the smarter the Agent.

```python
from agno.agent import Agent
from agno.models.openai import OpenAIChat

agent = Agent(
    model=OpenAIChat(id="gpt-5-mini"),
    description="Share 15 minute healthy recipes.",
    markdown=True,
)
agent.print_response("Share a breakfast recipe.", stream=True)
```

<Tip>
Use [model strings](/concepts/models/model-as-string) (`"provider:model_id"`) for simpler configuration. For advanced use cases requiring custom parameters like `temperature` or `max_tokens`, use the full model class syntax.
</Tip>

## Error handling

You can set `exponential_backoff` to `True` on the `Agent` to automatically retry requests that fail due to third-party model provider errors.

```python
agent = Agent(
    model=OpenAIChat(id="gpt-5-mini"),
    exponential_backoff=True,
    retries=2,
    retry_delay=1,
)
```

## Supported Models

Agno supports the following model providers organized by category:

### Native Model Providers

<CardGroup cols={3}>
  <Card
    title="Anthropic"
    icon="brain"
    iconType="duotone"
    href="/concepts/models/anthropic"
  >
    Anthropic Claude models integration.
  </Card>
  <Card
    title="Cohere"
    icon="robot"
    iconType="duotone"
    href="/concepts/models/cohere"
  >
    Cohere language models integration.
  </Card>
  <Card
    title="DashScope"
    icon="robot"
    iconType="duotone"
    href="/concepts/models/dashscope"
  >
    Alibaba Cloud DashScope models.
  </Card>
  <Card
    title="DeepSeek"
    icon="robot"
    iconType="duotone"
    href="/concepts/models/deepseek"
  >
    DeepSeek AI models integration.
  </Card>
  <Card
    title="Google Gemini"
    icon="google"
    iconType="duotone"
    href="/concepts/models/google"
  >
    Google Gemini models integration.
  </Card>
  <Card
    title="Meta"
    icon="meta"
    iconType="duotone"
    href="/concepts/models/meta"
  >
    Meta AI models integration.
  </Card>
  <Card
    title="Mistral"
    icon="wind"
    iconType="duotone"
    href="/concepts/models/mistral"
  >
    Mistral AI models integration.
  </Card>
  <Card
    title="OpenAI"
    icon="robot"
    iconType="duotone"
    href="/concepts/models/openai"
  >
    OpenAI models integration.
  </Card>
  <Card
    title="OpenAI Responses"
    icon="robot"
    iconType="duotone"
    href="/concepts/models/openai-responses"
  >
    OpenAI response format handling.
  </Card>
  <Card
    title="Perplexity"
    icon="question"
    iconType="duotone"
    href="/concepts/models/perplexity"
  >
    Perplexity AI models integration.
  </Card>
  <Card
    title="Vercel"
    icon="robot"
    iconType="duotone"
    href="/concepts/models/vercel"
  >
    Vercel AI models integration.
  </Card>
  <Card
    title="xAI"
    icon="x"
    iconType="duotone"
    href="/concepts/models/xai"
  >
    xAI models integration.
  </Card>
</CardGroup>

### Local Model Providers

<CardGroup cols={3}>
  <Card
    title="LlamaCpp"
    icon="robot"
    iconType="duotone"
    href="/concepts/models/llama_cpp"
  >
    LlamaCpp local model inference.
  </Card>
  <Card
    title="LM Studio"
    icon="laptop"
    iconType="duotone"
    href="/concepts/models/lmstudio"
  >
    LM Studio local model integration.
  </Card>
  <Card
    title="Ollama"
    icon="robot"
    iconType="duotone"
    href="/concepts/models/ollama"
  >
    Ollama local model integration.
  </Card>
  <Card
    title="VLLM"
    icon="server"
    iconType="duotone"
    href="/concepts/models/vllm"
  >
    VLLM high-throughput inference.
  </Card>
</CardGroup>

### Cloud Model Providers

<CardGroup cols={3}>
  <Card
    title="AWS Bedrock"
    icon="cloud"
    iconType="duotone"
    href="/concepts/models/aws-bedrock"
  >
    Amazon Web Services Bedrock models.
  </Card>
  <Card
    title="Claude via AWS Bedrock"
    icon="brain"
    iconType="duotone"
    href="/concepts/models/aws-claude"
  >
    Anthropic Claude models via AWS Bedrock.
  </Card>
  <Card
    title="Azure AI Foundry"
    icon="microsoft"
    iconType="duotone"
    href="/concepts/models/azure-ai-foundry"
  >
    Microsoft Azure AI Foundry models.
  </Card>
  <Card
    title="Azure OpenAI"
    icon="microsoft"
    iconType="duotone"
    href="/concepts/models/azure-openai"
  >
    Microsoft Azure OpenAI models.
  </Card>
  <Card
    title="Vertex AI Claude"
    icon="brain"
    iconType="duotone"
    href="/concepts/models/vertexai-claude"
  >
    Anthropic Claude models via Google Vertex AI.
  </Card>
  <Card
    title="IBM WatsonX"
    icon="robot"
    iconType="duotone"
    href="/concepts/models/ibm-watsonx"
  >
    IBM WatsonX models integration.
  </Card>
</CardGroup>

### Model Gateways & Aggregators

<CardGroup cols={3}>
  <Card
    title="AI/ML API"
    icon="robot"
    iconType="duotone"
    href="/concepts/models/aimlapi"
  >
    AI/ML API model provider integration.
  </Card>
  <Card
    title="Cerebras"
    icon="robot"
    iconType="duotone"
    href="/concepts/models/cerebras"
  >
    Cerebras AI models integration.
  </Card>
  <Card
    title="Cerebras OpenAI"
    icon="robot"
    iconType="duotone"
    href="/concepts/models/cerebras_openai"
  >
    Cerebras OpenAI-compatible models.
  </Card>
  <Card
    title="CometAPI"
    icon="comet"
    iconType="duotone"
    href="/concepts/models/cometapi"
  >
    CometAPI model provider integration.
  </Card>
  <Card
    title="DeepInfra"
    icon="infinity"
    iconType="duotone"
    href="/concepts/models/deepinfra"
  >
    DeepInfra model provider integration.
  </Card>
  <Card
    title="Fireworks"
    icon="fire"
    iconType="duotone"
    href="/concepts/models/fireworks"
  >
    Fireworks AI models integration.
  </Card>
  <Card
    title="Groq"
    icon="bolt"
    iconType="duotone"
    href="/concepts/models/groq"
  >
    Groq fast inference models.
  </Card>
  <Card
    title="Hugging Face"
    icon="robot"
    iconType="duotone"
    href="/concepts/models/huggingface"
  >
    Hugging Face models integration.
  </Card>
  <Card
    title="LangDB"
    icon="database"
    iconType="duotone"
    href="/concepts/models/langdb"
  >
    LangDB model provider integration.
  </Card>
  <Card
    title="LiteLLM"
    icon="lightbulb"
    iconType="duotone"
    href="/concepts/models/litellm"
  >
    LiteLLM unified model interface.
  </Card>
  <Card
    title="LiteLLM OpenAI"
    icon="lightbulb"
    iconType="duotone"
    href="/concepts/models/litellm_openai"
  >
    LiteLLM OpenAI-compatible models.
  </Card>
  <Card
    title="Nebius AI Studio"
    icon="star"
    iconType="duotone"
    href="/concepts/models/nebius"
  >
    Nebius AI Studio models.
  </Card>
  <Card
    title="Nexus"
    icon="link"
    iconType="duotone"
    href="/concepts/models/nexus"
  >
    Nexus model provider integration.
  </Card>
  <Card
    title="NVIDIA"
    icon="robot"
    iconType="duotone"
    href="/concepts/models/nvidia"
  >
    NVIDIA AI models integration.
  </Card>
  <Card
    title="OpenRouter"
    icon="route"
    iconType="duotone"
    href="/concepts/models/openrouter"
  >
    OpenRouter model aggregation.
  </Card>
  <Card
    title="Portkey"
    icon="key"
    iconType="duotone"
    href="/concepts/models/portkey"
  >
    Portkey model gateway integration.
  </Card>
  <Card
    title="Requesty"
    icon="robot"
    iconType="duotone"
    href="/concepts/models/requesty"
  >
    Requesty model provider integration.
  </Card>
  <Card
    title="Sambanova"
    icon="server"
    iconType="duotone"
    href="/concepts/models/sambanova"
  >
    SambaNova AI models integration.
  </Card>
  <Card
    title="SiliconFlow"
    icon="robot"
    iconType="duotone"
    href="/concepts/models/siliconflow"
  >
    SiliconFlow model provider.
  </Card>
  <Card
    title="Together"
    icon="users"
    iconType="duotone"
    href="/concepts/models/together"
  >
    Together AI models integration.
  </Card>
</CardGroup>

Each provider offers a different set of models, with different capabilities and features. By default, Agno supports all models provided by the mentioned providers.
